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2k — 1 and with 2k — 4 (interior) knots. Simulations were performed 
to check the validity of the conjecture. We present strong numerical 
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evidence in support of the conjecture for k = 3, • • • , 10 when the inter- 
polated function belongs to C^ 2fc ' [0, 1], the class of 2fc-times continuously 
differentiable functions on [0, 1]. In this case, the worst interpolation er- 
ror is proved to be attained by the perfect spline of degree 2k with the 
same knots as the spline interpolant. This interpolation problem arises 
naturally in nonparametric estimation of a multiply monotone density 
via Least Squares and Maximum Likehood methods. 

AMS 2000 subject classifications: Primary 41A15, 41A17; secondary 
62G05, 62E20. 

Keywords and phrases: multiply monotone density,, Hermite inter- 
polation,, interpolation error,, odd-degree splines,. 

1. Introduction 

Interpolation via splines of degree 2k — 1 with simple knots has been consid- 
ered for different boundary conditions that the spline interpolant is required 
to satisfy (see e.g. [Schoenberg 1964a; 1964b] and [Niirnberger 1989, pages 
116-123]. One particular aspect of these problems is that the k-th deriva- 
tive of the spline interpolant gives the minimal L2-norm among all functions 
that are smooth enough and satisfy the same boundary conditions (see e.g. 
[de Boor 1964; 1974], [Holladay 1957], [Schoenberg 1964a; 1964b; 1964c], 
[Niirnberger 1989]). In the particular case of complete and natural interpo- 
lation of elements in the Sobolev space W l v via a spline of a given degree 
2k — 1, this optimality property was a good starting point to prove that the 
the Lp-norm of the interpolation error is independent of the locations of the 
knots (see [Shadrin 1992] and the references given there). We recall here that 
given a function / on [0, 1], = To < t\ < . . . < r m _i < r m = 1 and k > 1 
an integer, a spline s with degree 2k — 1 and (simple) knots t±, ■ ■ ■ , r m _i is 
the complete spline if and only if ||s( fc ) [[2 minimizes \\g^ H2 over all functions 
g G satisfying 

9(Tj) = f(Tj), for j = 0, . . . , m 

9 {r) (r )=g (t) (ro), g {t) (r m ) = f (r) (r m ) for all i = 1, . . . , fe — 1, (1) 
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and is the natural spline if and only if |js^ fc ^||2 minimizes ||g( fc )||2 over all 
functions g £ W% satisfying 

9(Tj) = f(Tj), for j = 0, . . . , m, (2) 

(see e.g. [Holladay 1957], [de Boor 1964; 1974], [Schoenberg 1964a; 1964b; 
1964c], [Shadrin 1992]). 

Natural cubic splines (k = 2) go back at least to [Holladay 1957]. [Holladay 
1957] was apparently the first to prove that the unique spline that satisfies 
the conditions in (2), and such that it is a cubic polynomial to the left and to 
the right of To and T m respectively is equal to the natural spline interpolant. 
In general, a natural spline s of degree 2k — 1 > 3 admits a polynomial 
extension of degree 2k — 1 to the left and right of the boundary points To 
and T m respectively; i.e., 

S W (r ) = s W (r m ) = 0, for alU = k, . . . , 2k - 2 (3) 

(see e.g. [Schoenberg 1964a; 1964b; 1964c], [Niirnberger 1989]). 

If we fix the number of knots, and take h to be the maximal distance 
between two successive knots, it follows from Theorem 6.4 of [Shadrin 1992] 
that there exists c\ > (depending only on k) such that 

\\f® - s® Wo, Ktzh 1 -* ||/«|U, (4) 

where / G C^)[0, l],0<i<fc</< 2k, and s is either the (corresponding) 
natural or complete spline interpolant ([Shadrin 1992] makes this assertion 
for / in the Sobolev space W^, but via a standard Sobolev embedding 
theorem (see e.g. [Adams and Fournier, 2003], pages 80, 85) this implies the 
stated inequality). The result provides bounds that are independent of the 
locations of the knots t\, . . . , r m _i. In particular, if / is C^ 2k ^[0, 1], and s is 
its complete spline interpolant then 

||/-s||oo<Ci/» 2fc ||/( 2fc )||oo, 
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a bound that [de Boor 1974] had conjectured for k > 4. In connection with 
the previous bound, [de Boor 1974] found that it was sufficient to show 
boundedness of the supremum norm of the L2-projector of C^[0, 1] on the 
space of splines of degree k — 1 with knots n, . . . , r n _i. In other words, de 
Boor conjectured that there exists some constant dk > (depending only 
on k) such that for any nontrivial function / in [0, 1] 

SUP -jTTTj < 4, (5) 

0<Ti<-<T m _i<l \\j\\oo 

where Pf is the orthogonal projection of / on the space of splines of degree 
k — 1 with knots n, ■ • • , r m _i, equipped with the ordinary inner product 



(«i,S2) = / s l (t)s 2 {t)dt, 
Jo 

(see also [Shadrin 2001]). Apparently, de Boor had conjectured such a result 
for the first time in 1972 ([de Boor 1973]). However, the conjecture remained 
unsolved for more than 25 years before [Shadrin 2001] found a proof. The 
bound in (5) combined with the techniques developed by [de Boor 1974] for 
bounding interpolation error implies that there exists dj t k > depending 
only on j and k such that 

\\f-s\\<dj, k h k+ i ||/^|U, 

for all functions / G C^ k+j \j = 0, . . . , k. The latter can obviously be viewed 
as a special case of (4), with i = 0, I = k + j and dj^ = c\. However, the 
bound in (5) makes the inequality in (4) valid for i = k as well, and hence 
it provides a stronger result. 



2. A new Hermite interpolation problem 
2.1. Description of the problem 

Let k > 2 be a fixed integer, and consider tq = < t\ < ■ ■ ■ < r 2 fc-4 < 
T~2k-3 = 1- Given a function / defined on [0, 1] and at least differentiable at 
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the 2k — 2 points r, for i = 0, ■ • • , 2k — 3, we denote by H k f the unique spline 
of degree 2k — 1 with (simple) knots n, • ■ ■ ,T2fc~4 that satisfies the 4/c — 4 
linear conditions 

(H k f)( n ) = fin), and (H k f)'(T i ) = f'(T i ) for i = 0, ■ ■ ■ , 2* - 3. (6) 

In what follows, we denote by £k(f) the associated interpolation error / — 
-fffc/. Existence and uniqueness of the solution follows easily from the 
Schoenberg-Whitney-Karlin-Ziegler Theorem 

([Schoenberg and Whitney 1953]; Theorem 3, page 529, [Karlin and Ziegler 
1966] ; or see Theorem 3.7, page 109, [Niirnberger 1989]; or Theorem 9.2, 
page 162, [DeVore and Lorentz 1993] ). When k = 2, the problem reduces 
to complete interpolation via a cubic polynomial. The latter is of less con- 
cern since asymptotic theory for the motivating statistical problem has al- 
ready been developed for this case; see [Groeneboom, Jongbloed, and Well- 
ner (2001a), (2001b)]. We therefore assume hereafter that k > 3. 

This problem seems to be new in the sense that it has not been considered 
by the literature on interpolation via splines in general. Unlike in complete 
or natural interpolation, the "smoothing" boundary conditions of the spline 
interpolant H k f are not being absorbed at the boundary points tq and T m 
with m = 2k — 3 (here we refer to the conditions in (1) and (3)) but instead, 
are "re-distributed" somehow evenly among the knots. Another feature of 
this problem is that the number of knots of the spline interpolant depends on 
its degree, which seems to be somewhat unusual (personal communication 
with Nira Dyn). On the other hand, functions that are not twice differen- 
tiable or smoother on [0, 1] can be very well interpolated as long as they are 
differentiable at Tj for i = 0, • • • , 2k — 3. Whether the interpolation error is 
bounded for these functions remains an open question, but it is clear that 
they are eliminated from the scheme of complete or natural interpolation 
via splines of degree > 3. 
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2.2. Motivation 

The consideration of this "non-standard" Hermite interpolation problem was 
originally motivated by a nonparametric estimation problem in a certain 
class of shape-constrained densities. In fact, it arises naturally in connection 
with the asymptotic distribution of the Least Squares (LS) and Maximum 
Likelihood (ML) estimators of a /c-monotone density g on (0, oo); i.e., a 
density that satisfies: (—l) l g^ is nonincreasing and convex for I = 0, • ■ ■ , k — 
2. Let Xi, ■ ■ ■ ,X n be n independent random variables with a common k- 
monotone density go. Let G n be the empirical distribution of the Xj's; i.e. 



It has been shown [Balabdaoui and Wellner 2004a] that both the ML and 
LS estimators, denoted hereafter by g n and g n respectively, are splines of 
degree k — 1 with simple (random) knots. The number and the locations 
of these are uniquely determined by the minimization problem defining the 
estimators (and the data via G n ), and they can be computed via an itera- 
tive spline algorithm (see [Balabdaoui and Wellner 2004b]). Now, when the 
true fc-monotone density go is assumed to be fc-times differentiable at some 
fixed point xo > such that (—l) k gQ k \xo) > and g^ is continuous in the 
neighborhood of xo, then the number of knots around Xo increases to infinity 
almost surely and hence the distance between two successive knots decreases 
to 0. It turns out that proving that the stochastic order of this distance is 
n -i/(2k+i) as n ^ oo is the main key to deriving the exact rates of conver- 
gence of gn\%o) or gn\xo), j = 0, ■ ■ ■ , k — 1, as well as the corresponding 
limiting distribution. 

Here we choose to focus on g n rather than g n since it is easier through 
the simple characterization of g n to make the link between the new Hermite 
problem in (6) and the nonparametric estimation problem. It has been shown 
[Balabdaoui and Wellner 2004a] that a necessary and sufficient condition for 
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a /c-monotone function g n to be equal to the LSE is given by 
H n {x) > Y n {x), for all x > 

H n (x) = Y n (x), if (-l)*^*" 1 ^-) < (-lf~ g { t l \x+), 
where 

and 

Y ™W = Jkhy jf ( a - *) fe_1 ^ n (t). 

In other words, H n and Y ra are the /c-fold and (k — l)-fold integrals of g n and 
G n respectively, and their corresponding curves have to touch each other 
at every knot of g n . Note also that H n is a spline of degree 2 k — 1 with 
the same knots as g n . Now, if we assume that g n has at least 2k — 2 knots 
ro < • • • < r 2 fc_3 in the neighborhood of xq, an event that occurs with 
probability — ► 1 as n — > oo, then it follows from the characterization in (7) 
that 

H n (r i )=Y n (r i ) and fl^) = Y^fa) 

for i = 0, ■ • • , 2fc-3. Hence, F n = i? fc Y n on [tq, T2jfc_3], an identity that plays 
a major role in studying the distance between consecutive knots. Through 
this identity, the Least Square esimator, which in essence estimates the whole 
density, could be studied locally in the neighborhood of the point of interest 
xq. To be able to obtain the stochastic order of the distance between the 
knots of the estimator, arguments from empirical processes theory ([van 
der Vaart and Wellner 1996]) are used in combination with the current 
conjecture on the interpolation error. For more technical details, we refer to 
[Balabdaoui and Wellner 2004d, page 12, Lemma 2.3]. Another version of 
this same problem arises in showing the existence of a solution to the natural 
Gaussian version of the problem [see Balabdaoui and Wellner 2004c]. 
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2.3. The conjecture 

Proving that the distance between successive knots is indeed of the stochastic 
order n _1 ^ 2fc+1 ^ as n — > oo still depends on bounding ||£fc(/)||oo indepen- 
dently of the locations of the knots, for any function (k — l)-differentiable 
function / such that /( fe_1 ) admits a finite total variation. For more details, 
see [Balabdaoui and Wellner 2004d, page 16, Lemma 2.4]. We formulate our 
conjecture as follows: 

Conjecture 2.1 Let tq = < t\ < ■ ■ ■ < r 2 fc_4 < T2k~3 = 1 and u £ (0, 1). 

If f u (t) = (t — u) h ^T 1 /(k — 1)!, then there exists c& > such that 

SUp SUp ||£fc(/ u )||oo < Cfc. (8) 

m€(0,1) 0<r 1 <---<r 2fc _4<l 

If the bound in (8) is true, then we can establish the following lemma: 

Lemma 2.1 If (8) holds, then for any function f in C^+^O, 1], j = 0, ■ • • , k, 

we have 

\\W)\\oo<Jj^ ll/^lloc (9) 

Proof. Using Taylor expansion we can write for all t € (0, 1) 
f(t) = /(0) + f'(0)t + ■■■+ 

= PkAV + + J\t - uf+i- 1 f^\u)du. 
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Since P k j is a polynomial of degree at most 2k — 1 for j = 0, • ■ ■ , k, it follows 
that 



£k(f) = 



l 



(k + j-l)\J 
on [0, 1], and hence, if j = 0, we have 

||4(/)|U<C fc ||/«||oo 

by the conjecture. Now, for j = 1, • • • , k, we can apply again Taylor expan- 
sion to the function t >— > (i — (it fixed) to obtain 

(/c + j - 1) • • • j f\ 



(t - n)^- 1 



'+ 



This implies that 



(k + j-l)---j f 1 



(k-iy. Jo 

< (k + j -!)■■■ j c k 

(k+j-iy 



H k (--v) k + - 1 -(--v) k + - 1 \ (v-uy-'dv 
{k + j -!)••• j 



[\v-uy- 1 

J u 

c fc (i - uy . 



dv 



-c fe (l - u) J 



and therefore 



IIW)lloo< 



(J + 1) 



Wf (k+J) \\c 



Remark. To conform more closely with the error bound given in the natural 
and complete interpolation problem, we note that the bound in (9) can be 
replaced by dkjh k+ i, where h denotes again the largest distance between 
two successive knots, and d k j < c k j2^ 2k ~ 3 ^ k+: >~ 1 \2k — 3), which follows 
from iterative application of the cv-inequality. 
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3. Computations 



3.1. Interpolating the hinge function f u 

In the absence of a theoretical proof of (8), a natural approach is to replicate 
the interpolation problem a number of times. The knots of the spline inter- 
polant as well as the single knot, u, of the hinge function /„ (the function 
being interpolated) are drawn independently from a uniform distribution on 
[0, 1]. The procedure can be simply described as follows: 

1. Generate 2k — 3 independent uniform random variables on (0, 1), 
Ul, ■ ■ ■ , U 2 k-3- 

2. Set (n, • • • , r 2 fc_ 4 ) = (U(i),- ■ ■ , U^k-4)) and u = U 2 k-3, where 
?7(i), • " " j U(2k-4) are the order statistics of U\, ■ ■ ■ , U2k-A- 

3. Find the spline Hkf u , and calculate the supremum norm error 

||£fc(/«)||oo. 

4. Store ||^(/u)||oo and repeat the previous steps. 

The Mathematica programs 'EB-SinglePrint-hinge-post' and 'EB-MC- 
hinge-post' used to produce the data are provided in the supporting ma- 
terial; see 

www.stat.washington.edu/jaw/RESEARCH/ SOFTWARE/software.list.html 

for all the programs used to produce the tables and figures. The first pro- 
gram produces the maximal interpolation error for a single run as well as 
the plot of the spline interpolant and that of the corresponding error. The 
Monte Carlo procedure described above can be run using the second pro- 
gram which produces a statistical summary as well as plots of the empirical 
distribution of the interpolation error. Choosing a large number of digits of 
the random numbers, d, seems to resolve some of the numerical issues that 
we have encountered: When some of the knots are extremely close to each 
other, the linear system becomes very close to being singular in which case 
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Mathematica suppresses the corresponding outcome. This suppression due 
to severe ill-conditioning of the matrices does not happen if d is taken to be 
appropriately large. However, we believe that other numerical instabilities 
do occur and become increasingly severe as we increase the value of k. For 
k = 3, • • • , 10, we performed 2 x 10 4 Monte Carlo replications. The corre- 
sponding statistical summaries can be found in Table 1. Of course, one is 
interested in the maximal interpolation error over all configurations, but it 
is also of some interest to get an idea about its distribution. In these simu- 
lations and further ones, the obtained maximal error over all knot configu- 
rations seems to be stable and reasonably small for k = 3,4, 5. However, the 
order of this maximal error seems to increase with k to reach extremely large 
values (10 13 for k = 10 !). Note that the values of the median and the 95%- 
quantile decay steadily. In the absence of theoretical argument that proves 
or disproves the conjecture, large maximal errors would cast doubt on the 
validity of the conjecture for large k. However, we have an evidence of numer- 
ical instabilities that will be presented and discussed in the next subsection. 
There, the interpolated function is much smoother than the hinge function 
since it is assumed to be 2/c-times continuously differentiable, nevertheless 
extremely large interpolation errors do also occur. These large maximal er- 
rors can be compared with much smaller bounds that could be obtained via 
the perfect splines theory. So in this particular case, both theory and simu- 
lations are combined to seek a stronger support for uniform boundedness of 
the interpolation error. 



3.2. Interpolation of f G C^[0, 1] 

We have proved in subsection 2.3 that provided that the conjecture is true, 
the interpolation error is uniformly bounded for any function in C^ k+ ^ [0,1], j = 
0, ■ • • , k with respect to ||/ < - fc+J, - ) ||oo- When j = k, the interpolated function 
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Table 1 

Statistical summary of the Loo-norm of the interpolation error, £k(fu), for k = 3, • • • , 10 
based on 10 4 + 10 4 independent simulations. Table produced using the Mathematica 
program 'EB-MC-hinge-post'. 



k 


Mean 


Median 




Std. dev. 


95%-q 




99%-q 




max 


3 


4.54 x 10" 3 


2.69 x 10" 


r*3 — 


8.8 x 10~ 3 


1.47 x 10" 


— 


3.44 x 10" 


"2 — 


3.2 x 10" 1 


3 


4.55 x 10" 3 


2.59 x 10" 


-3 


1.07 x 10" 2 


1.38 x 10" 


-2 


3.43 x 10" 


2 


5.4 x 10" 1 


4 


5.6 x 10" 4 


7.92 x 10" 


-5 


3.72 x 10" 3 


1.85 x 10" 


-3 


8.58 x 10" 


3 


1.8 x 10" 1 


4 


7.16 x 10" 4 


7.96 x 10" 


-5 


6.27 x 10" 3 


2 x 10" 3 




9.13 x 10" 


3 


3.2 x 10" 1 


5 


4.07 x 10" 4 


2.68 x 10" 


-fi 


9.11 x 10" 3 


3.87 x 10" 


4 


5 x 10" 3 




6 x 10" 1 


5 


2.97 x 10" 4 


2.75 x 10" 


-6 


5 x 10" 3 


4.05 x 10" 


4 


3.59 x 10" 


3 


3.35 x 10" 1 


6 


1.51 x 10" 2 


1.20 x 10" 


-7 


1.42 


1.41 x 10" 


4 


3 x 10" 3 




1.42 x 10 2 


6 


1.42 x 10" 2 


1.17 x 10" 


-7 


9 x 10" 2 


1.40 x 10" 


4 


2.44 x 10" 


3 


8.87 


7 


9.87 x 10" 2 


7.73 x 10" 


-9 


9.6 


6.53 x 10" 


5 


2.38 x 10" 


3 


9.6 x 10 2 


7 


2.06 x 10 2 


8.9 x 10" 


9 


2.05 x 10 5 


6.75 x 10" 


-5 


2.89 x 10" 


3 


2.05 x 10 6 


8 


9.11 


6.69 x 10" 


10 


8.03 x 10 2 


4.36 x 10" 


— 


4.41 x 10" 


3 


7.97 x 10 b 


8 


5.5 x 10" 1 


6.62 x 10" 


10 


3.92 x 10 1 


4 x 10" 5 




2.83 x 10" 




3.41 x 10 4 


9 


4.57 x 10 2 


7.58 x 10" 


11 


3.38 x lO* 


2.47 x 10" 




1.12 x 10" 


•1 


3.31 x 10 b 


9 


1.83 x 10 1 


6.79 x 10" 


11 


1.71 x 10 4 


2.63 x 10" 


-5 


7.36 x 10" 


3 


1.71 x 10 6 


10 


1.4 x 10 Y 


1.06 x 10" 


11 


1.37 x 10 a 


2.94 x 10" 


-5 


3.82 x 10" 


•1 


1.37 x 10 11 


10 


1.70 x 10 9 


1.16 x 10" 


11 


1.70 x 10 11 


3.9 x 10" 


5 


8.95 x 10" 


2 


1.7 x 10 13 



/ is 2/c-times continuously differentiable on [0,1]. It turns out in this par- 
ticular case that one can take another route to seek evidence for uniform 
boundedness of the interpolation error with respect to 11/"^^ lloo* 

Indeed, the interpolation error can be bounded more explicitly by the error 
for interpolation of a perfect spline, as was pointed out to us by A. Shadrin. 
In this particular case, for a fixed set of knots < t\ < ■ ■ ■ < T2k-i < 1, we 
have 

sup \f(t) - [H k f](t)\ < \S*(t) - [H k S*](t)\, (10) 

ll/( 2fc 'l|oo<l 

for all t G [0, 1] where S* is a perfect spline of degree 2k with knots 
t~i, ■ ■ ■ , T2fc-4 which satisfies 



s*(t) = (-iy, t€[rj,T j+1 ) (ii) 



for j = 0, . . . , 2k — 4 (with the usual convention that tq = 1 and T2k-3 = 1)- 
Recall here that a perfect spline P of degree 2k with knots n, . . . , T2k-A and 
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satisfying the condition (11) is of the form 

2k-l / 2k-A \ 

P(t) = £ * t f + ^ f i 2fc + 2 £ ("!)*(* " r,-)?J , 

where CKj G E for i = 0, . . . , 2k— 1 (see e.g. [Bojanov, Hakopian, and Sahakian 
1993] for a more general form). The inequality in (10) says that for any 
fixed set of knots the perfect spline gives the largest interpolation error, 
pointwise, over the set of 2k— times continuously differentiable functions 
such that ||/ ( - 2fc - ) ||oo < 1- Note that since polynomials of degree 2k — 1 are 
exactly recovered by the interpolation operator H k , the perfect spline can 
be taken to be equal to 

Here, we omit writing explicitly the dependence of S* on the knots, but 
it should nevertheless be kept in mind. The bound in (10) provides a very 
useful way to verify computationally the conjecture for the class [0, 1] 
since for any / G C( 2fc )[0, 1] it follows that 

sup \\f-[H k f]\\ < H/^IU sup \\S* - [flfcS-lHoo, 

0<T 1 <---<r 2fc _ 4 <l 0<Tl<-<T 2fc _4<l 

and hence our conjecture holds for the class [0, 1] if the right side in 
the last display stays bounded. 

The bound in (10) can be proved using for example the same arguments 
of the proof of Lemma 6.16 in [Bojanov, Hakopian, and Sahakian 1993]. 
Indeed, let / € C( 2fc )[0,l] with ||/ (2fc) ||oo < 1 and suppose that there exists 
to G (0, 1) such that 

\f(to) ~ [H k f](t )\ > \S*(t ) - [H k S*](t )\. (12) 

Note that to / rj,j = 0, • • • , 2k — 3 since H k f interpolates / at the t/s. Let 

f(t Q ) - [H k f](t ) 
a S*(t ) - [H k S*](t ) 
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and consider the function 

hit) = f(t) - [H k f](t) - a (5*(t) - [H k S*](t)) , t G [0, 1]. 

By assumption (12) it follows that \a\ > 1. On the other hand, the function 
h admits at least 4k — 4+1 = 4/c — 3 zeros: Tj,j = 0,---,2k — 2 (counting 
multiplicities) and to- It follows by Rolle's theorem that /i( 2fc_2 ) has at least 
4k — 3 — (2k — 2) = 2k — 1 distinct zeros. Now, note that h^ 2k ~ 2 ^ is a contin- 
uous function on [0, 1] whose first derivative h^ 2k ^^ might only jump at the 
internal knots. This implies that /j( 2fc_1 ) will change its sign at least 2k — 2 
times. However, the latter is impossible. Indeed, since \a\ > 1, ||/^ 2 ^||oo 

< 1 

and \(S*)( 2k \t)\ = l,te (Tj,T j+ i) for j = 0, ■ • • ,2k - 4, it follows that 

sign hW(t) = -sign (a(S*) (2k) (t)) , for t G (t v t 3+1 ) 

and therefore the function h^ 2k ^ will have the same number of sign changes 
as (S*)( 2k \ namely 2k — 4, and the sign changes occur when t takes values 
in the set of internal knots Tj, j = 1, ... ,2k — 4. This in turn implies that 
^(2fc-i) at mos t 2k — 3 sign changes. The contradiction completes the 
proof. 

Our numerical results based on 10 4 Monte Carlo replications point to 
boundedness of the interpolation error for the perfect spline and are reported 
in Table 2 for k = 3, • • • , 10 where the column labelled "factor" multiplies 
all of the preceding columns. Note the particular pattern of decay of the 
maximal error as k increases. 



The last column corresponds to the maximal error for interpolating the 
perfect spline x(2k)\. This gives an upper bound for the error for inter- 
polating fo(t) = t 2k ; i.e., an upper bound for the supremum norm of the 
monospline /o — -fffc/o- The obtained products seem to remain very close to 
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Table 2 

Statistical summary of the sup-norm of the interpolation error, £k(S*), for k — 3, ■ • • , 10 
based on 10 4 simulations. Table produced using the Mathematica program 'PS-MC-post'. 



k 


Mean 


Std. dev. 


Median 


95%-q 


99%-q 


max 


factor 


max x(2fc)! 


3 


1.71 


1.10 


2.15 


2.77 


2.78 


2.78 


xl0~ d 


2.001 


4 


2.77 


1.86 


3.28 


4.94 


4.96 


4.96 


xl0~ b 


1.999 


5 


2.84 


2.04 


3.18 


5.46 


5.50 


5.51 


xl0~ y 


1.999 


6 


2.08 


1.53 


2.33 


4.12 


4.17 


4.18 


xlO~ M 


2.002 


7 


1.09 


8.37 


1.19 


2.25 


2.29 


2.29 


xlO -11 


1.996 


8 


4.36 


3.51 


5.03 


8.99 


9.52 


9.54 


xlO" 14 


1.996 


9 


1.47 


1.08 


1.43 


3.00 


3.08 


3.10 


xlO" 16 


1.987 


10 


3.86 


2.94 


4.34 


8.00 


8.19 


8.21 


xlO~ la 


1.999 



2, which is rather an interesting outcome in its own right. We should men- 
tion here that simulations with a larger number of replications (2 x 10 4 and 
5 x 10 4 ) yielded similar statistics to those reported in Table 2. 



A natural question to ask is whether the obtained bounds are actually 
achieved by the corresponding monosplines. Based on 10 4 simulations, a 
statistical summary of ||/o — -fffc/olloo = ||£fc(/o)|| an d that of the complete 
interpolation error are obtained for k = 3, • • • , 10 and reported in Table 3. 
The results show two different aspects. On one hand, we see that the maximal 
Hermite interpolation error is much smaller than 2 for the values k = 3, 4, 5, 
and that the errors given by the Hermite and complete spline interpolants 
are quite comparable. On the other hand, when k > 7, the obtained maximal 
errors given by the Hermite spline are very large. We believe that these large 
values result from numerical instabilities as they are not at all in agreement 
with the rather stable upper bounds given by the perfect splines. In order to 
investigate more this latter aspect, the 10 largest interpolation errors have 
been isolated but more importantly the corresponding configurations of the 
knots (for more numerical details, see the Mathematica program 'MN-MC- 
Configlsol-post'). In Table 4 we report the largest and second largest error 
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Table 3 

Statistical summary of the sup-norm of the interpolation error given by the Hermite (first 

row) and complete (second row) spline interpolants for interpolating fo(t) = t 2k and 
k = 3, • • • , 10 based on 10 4 simulations. Table produced using the Mathematica programs 
'MN-MC-post 'and 'MS-MC- Configlsol-post '. 



K 




Median 




oici. aev. 


yo/o-q 




99%-q 




max 


3 


2.52 x 10~ 3 


1.17 x 10" 


-3 


3.24 x 10~ 3 


9.68 x 10 


-3 


1.47 x 10" 


-'i 


2.14 x 10~ 2 


3 


2.74 x 10~ 3 


1.62 x 10" 


-3 


2.85 x 10~ 3 


8.93 x 10 


-3 


1.22 x 10" 


-2 


1.53 x 10~ 2 


4 


1.36 x 10~ 4 


4.18 x 10" 


-5 


3.12 x 10~ 4 


5.44 x 10 


-4 


1.5 x 10" 


3 


6.89 x 10~ 3 


4 


1.27 x 10~ 4 


4.14 x 10" 


-5 


2.39 x 10~ 4 


5.63 x 10 


-4 


1.22 x 10" 


-3 


3.24 x 10 -3 


5 


1.67 x 10~ b 


3.2 x 10" 


6 


10" 4 


6.67 x 10 


-5 


2 x 10" 4 


8.5 x 10~ 3 


5 


5.74 x 10" 6 


1.04 x 10" 


-6 


1.64 x 10~ 5 


2.66 x 10" 


-5 


7.31 x 10" 


-5 


3.97 x 10~ 4 


6 


2.26 x 10~ 4 


4.13 x 10" 


-7 


1.1 x 10^ 


3.31 x 10 


-5 


2.45 x 10" 


-4 


1.02 


6 


2.6 x 10~ 7 


2.51 x 10" 


-8 


1.09 x 10" 6 


1.07 x 10 


-6 


4.55 x 10" 


-6 


3.77 x 10" 6 


7 


4.01 


8.63 x 10" 


-8 


4.01 x 10 2 


2.93 x 10 


-5 


7.97 x 10" 


-4 


4.01 x 10 a 


7 


1.16 x 10" 8 


5.52 x 10" 


10 


8.35 x 10" 8 


3.91 x 10 


-8 


2.02 x 10" 


-7 


5.21 x 10" 6 


8 


1.83 x 10 b 


3.13 x 10" 


-8 


1.83 x 10 8 


4.35 x 10 


-5 


4.43 x 10" 


-3 


1.83 x 10 1U 


8 


5.93 x 10~ 10 


1.41 x 10" 


11 


6.94 x 10" 9 


1.50 x 10" 


-9 


1.15 x 10" 


-8 


5.65 x 10~ 7 


9 


1.15 x 10 b 


1.7 x 10" 


8 


1.14 x 10" 


1.5 x 10" 


4 


3.8 x 10" 


'1 


1.14 x 10 s 


9 


2.07 x 10~ n 


3.03 x 10" 


13 


2.53 x 10~ 10 


4.74 x 10" 


11 


2.81 x 10" 


10 


1.65 x 10" 8 


10 


8.43 x 10 1U 


1.19 x 10" 


-8 


8.42 x 10" 


4.05 x 10 


-4 


2.12 x 10" 


-'1 


8.42 x 10 14 


10 


9.65 x 10~ 13 


6.51 x 10" 


15 


2.26 x 10 -11 


1.41 x 10" 


12 


1.46 x 10" 


11 


2.11 x 10" 9 



that have occurred over 10 4 independent replications and the corresponding 
knot configurations, for k = 7, • • ■ , 10. In the table, we underline the knots 
whose in-between distances are of the order of 1CT 3 . The closeness of two 
knots or more is expected to result in severe ill-conditioning of the linear 
system to be solved. For these "bad" configurations, stability of the complete 
problem might be partially explained by the fact that only the function is 
interpolated. As we interpolate also the first derivatives at the knots, having 
them very close to each other makes the linear system in our problem much 
closer to being singular. 



Although the following fact is rather peripheral to the main problem treated 
in this paper, we would like to record it here. The result was brought to our 
attention by C. de Boor. When the knots of the spline interpolant are equally 
spaced; i.e., Tj + \ — Tj = 2I }_ 3 , j = 0, • • • , 2k — 4, the interpolation error £k(fo) 
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Table 4 

Knot configurations for the largest and second largest maximal Hermite interpolation 
errors (e\ and ei) for interpolating fo and k — 7,8,9, 10 based on 10 4 simulations. Table 
produced using the Mathematica program 'MS-MC-Configlsol-post'. 



k 


ei 


Config. 


e2 


Config. 


7 


4.01 x 10 5 


0.022 0.065 0.095 
0.269 0.272 0.377 
0.582 0.678 0.685 0.686 


2.05 


0.3433 0.3439 0.3444 
0.4709 0.5058 0.5327 
0.6057 0.9460 0.9472 0.999 


8 


1.83 x 10 10 


0.0810 0.1265 0.1360 
0.1410 0.1573 0.1680 
0.3770 0.3820 0.6975 
0.7873 0.7873 0.7879 


7.09 x 10 6 


0.0178 0.0709 0.0960 
0.105 0.153 0.279 
0.308 0.366 0.380 

0.7477 0.7478 0.7505 


9 


1.14 x 10 s 


0.2901 0.2905 0.2933 0.4046 
0.442 0.510 0.530 
0.732 0.747 0.891 
0.894 0.903 0.943 0.973 


7.71 x 10 5 


0.023 0.064 0.128 0.160 
0.198 0.275 0.399 
0.551 0.593 0.624 

0.652 0.683 0.686 0.688 


10 


8.42 x 10 14 


0.241 0.241 0.292 0.322 
0.340 0.362 0.375 0.436 
0.467 0.586 0.704 0.761 
0.789 0.8890 0.8892 0.8894 


6.17 x 10 11 


0.1721 0.1726 0.1739 0.2551 
0.382 0.601 0.613 0.701 
0.743 0.745 0.763 0.783 
0.802 0.826 0.953 0.965 



is the periodic monospline of degree 2k of period I /{2k — 3), that we denote 
here by M 2 k- One can prove that this monospline is of one sign on [0, 1] as 
it has 4k — 4 (double) zeros, and that this number is maximal [Corollary 1, 
page 422 of Micchelli 1972; Theorem 7.1 in Bojanov, Hakopian and Sahakian 
1993]. Furthermore, it can be shown that, on [0, l/(2k — 3)], we have 

M 2k (t) = (2A / 3)2fc (g 2fc ((2fc - 3)t) - B 2k ), 

where B 2 k is the Bernoulli polynomial of degree 2k, and B 2 k = B 2 k{0) is the 
corresponding Bernoulli number. In this case, the norm of the interpo- 
lation error is given by 

l|A%IU = ' 3)2 J g2fc(l/2)--B2tl 

using the identity B 2 k{l/2) = — (1 — 2 1 ~ 2k )B 2 k. The order of the maximal 
error decreases quickly with k, and its values for 3 < k < 6 are reported in 



imsart ver. 2005/05/19 file: kmon-p5-bwf2.tex date: February 2, 2008 



Balabdaoui and Wellner/Conjecture: error boundedness Hermite interpolation 18 

Table 5 

Some values of the -norm of the interpolation error for interpolating t 2k on [0, 1] 
when the knots are equispaced. Table produced using the Mathematica program 

'MN-SinglePrint-post '. 



k 


Bernoulli number B^k 


Maximal error 


3 


1/42 


1/15552 w 6.3 x 10~ b 


4 


-1/30 


17/100000000 = 1.7 x 10" ' 


5 


5/66 


155/289254654976 « 5.35 x 10~ lu 


6 


-691/2730 


691/385610460475392 w 1.71 x lO -1 ^ 



Table 5. We conjecture that, for a fixed k, this maximal error is the smallest 
over all configurations of the knots. 



4. Conclusions and open questions 

As mentioned in section 2, our Hermite interpolation arises naturally in 
the study of the stochastic behavior of the Least Squares and Maximum 
Likelihood estimators of a /e-monotone density. Considering interpolation of 
the hinge functions f u ,u € (0, 1) might appear somewhat too ambitious as 
boundedness of the error independently of the locations of the knots in this 
problem is only a sufficient condition for the result to hold for smoother 
classes of functions. But as a matter of fact, hinge functions constitute a 
basis of the (k — l)-fold integral of empirical distribution functions which 
are involved in the original estimation problem and play a major a role in 
understanding the asymptotic properties of the estimators (for more techni- 
cal details see [Balabdaoui and Wellner 2004d, page 16, Lemma 2.4]). Our 
numerical investigations point partially to the validity of the conjecture for 
small values of k but leave us with more unanswered questions for larger 
values. 
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0.2 0.4 0.6 0.8 1 

Fig 1. Plot of the hinge function f u (t) = (t — u)\~ 1 /(k — 1)! with u = 0.66 and k — 3 
(solid line) and its Hermite spline interpolant (dashed line). The interior knots are 0.54, 
0.55. Plot produced using the Mathematica program 'EB-SinglePrint-hinge-post' . 




Fig 2. Plot of the Hermite interpolation error for interpolating the hinge function f u (t) — 
(t—u)^r 1 /(k — l)\ withu = 0.66 andk = 3. The interior knots are 0.54, 0.55. The maximal 
error is 1.28 x 10~ 3 . Plot produced using the Mathematica program ' EB-SinglePrint-hinge- 
post'. 
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On the other hand, our simulations based on the perfect splines theory 
suggest strongly that the conjecture is true when the interpolated function 
belongs to the C^ 2k ^[0, 1], another class that is also of great relevance for us in 
connection with the same estimation problems (see [Balabdaoui and Wellner 
2004d, page 16, Lemma 2.4]). In the particular case of f(t) = fo(t) = t 2k , 
it follows from the maximal error for interpolating the perfect spline that 
there exists some constant > very close to 2 such that 

SUp H/o-tffc/oHoc <4||/ (2fc) ||oc 

0<Tl<-<T 2 fc_4<l 

The importance of the latter result is two-fold: beside that it gives a uniform 
upper bound on the monospline (it turns out that this bound can be greatly 
improved for small values of k, see Table 3), it serves as a way of checking 
the numerical stability of the solution given by interpolating "directly" /o- 
The extremely large values obtained for the ||£fc(/o)||oc f° r k = 7, • • • , 10 are 
believed to be due to severe ill-conditioning of the problem as some of the 
knots are very close to each other (see Table 4). This might explain also the 
large errors obtained for interpolating the hinge functions f u ,u G (0, 1) for 
large values if k. 
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Fig 3. Plot of the hinge function f u (t) = (t — u) 1 ^ 1 /(k—l)\ withu = 0.30 and k = 4 (solid 
line) and its Hermite spline interpolant (dashed line). The interior knots are 0.11, 0.33, 
0.49, 0.50. Plot produced using the Mathematica program 'EB-SinglePrint-hinge-post'. 
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Fig 4. Plot of the Hermite interpolation error for interpolating the hinge function f u (t) = 
(t - w)^. _1 /(fe - 1)! with u = 0.30 and k = 4. The interior knots are 0.11, 0.33, 0.49, 0.50. 
The maximal error is 6.8 x 10~ 4 . Plot produced using the Mathematica program 'EB- 
SinglePrint-hinge-post '. 
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0.0004 - S- 



0.0003- \ 




Fig 5. Plot of the Hermite (solid line) and complete (dashed line) interpolation error for 
fo(t) = t 2k on [0,1] for k = 3. The maximal Hermite and complete interpolation errors 
are 1.76 x 1CP 4 and 4 x 1CT 4 respectively. The interior knots are 0.30, 0.70. Plot produced 
using the Mathematica program 'MN-SinglePrint-post' . 
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-0 .00014 
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-0.00008 



-0.00012 



-0 .00006 



-0.00002 



-0.0001 




/ 



/ 



. 6 



0.8 



Fig 6. Plot of the Hermite (solid line) and complete (dashed line) interpolation error for 
/o(t) = t 2k on [0, 1] for k = 4. The maximal Hermite and complete interpolation errors 
are 1.5 x 1CF 4 and 8.31 x 10 -5 respectively. The interior knots are 0.55, 0.60, 0.74, 0.76. 
Plot produced using the Mathematica program 'MN-SinglePrint-post'. 

A part of this experimental work was not presented here and deals mainly 
with further computations aiming at checking whether there is any effect of 
using the B-spline basis as opposed to the canonical basis. The outcomes 
of many simulations that were performed with the two different bases and 
taking for every replication the same random knots were very comparable. 
On the other hand, we have done more comparisons between our Hermite 
interpolant and the complete one to get a better understanding about their 
relative goodness of approximation. One might think that our spline inter- 
polant problem should behave better than the complete spline in the case 
where the number of (interior) knots m — 1 = 2k — 4: the reasoning would 
be based on the fact that our spline interpolant matches not only the func- 
tion to be approximated at the knots (including the boundary points) but 
it also matches its tangent, and hence tries to "adapt" more to its shape. 
In all the examples that we have taken including fo(t) = t 2k disprove this 
idea. But the question remains open: Are there functions that are better 
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approximated (in the L^ sense) by our Hermite spline than by the com- 
plete spline? This question prompts another one in a different direction: We 
know that the perfect spline gives in our problem the largest interpolation 
error over the class C^[0, 1] and even over Sobolev space W%£, but what 
kind of functions give the worst interpolation error in the Sobolev space 
W^ 1 ? In the complete interpolation problem, [Shadrin 2001] makes use of 
the properties of the null spline to bound the orthogonal projector of C[0, 1] 
equipped with the Loo-norm on the space of splines of degree k — 1. The 
argument in our problem might need to involve such constructions as well. 
Finally, it seems natural to wonder whether, for a given sufficiently smooth 
function /, the spline H^f is the solution of some minimization problem: We 
wonder whether the L2-norm (or in general the L p -norm, p > 2) of (H^f)^ 
(or in general of (Hkf)^ for some j < k) minimizes some functional, yet 
to be defined. The problem seems to be hard to solve, and it is not clear 
yet in which direction one should try to find such a criterion, although the 
interpolation problem was first originated by a Least Squares problem. 

Our aim in this paper is to call attention to this new interpolation prob- 
lem, which plays the role of a bridge between deterministic spline theory 
and statistical estimation for k— monotone functions. 

Acknowledgments: We would like to thank Carl de Boor, Nira Dyn, Grace 
Wahba, and Alexi Yu. Shadrin for sharing with us their thoughts and sug- 
gestions about this interpolation problem, and Tilmann Gneiting for sev- 
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